MASSACHUSETTS INSTITUTE TECHNOLOGY 


PROJECT MAO 


Artificial Intelligence 

Memo, No, iISS September 196E 


RoCugnltJ.00 of Tonoloaical Invariants 

hi 

Modular Arrays 


3 i.'rry Bcvcr 


In this paper we study the recognition of topologically 
invariant properties of patterns by use of finite t rectangular 2- 
dimonBional* iterative arrays of finite stUEe automata (hereafter 
tailed modular arrays+) The use of modular arrays as pattern 
recognition devices has been studied by Atrubln [L] and by Unger [2], 
Our aim is to shot? that modular arrays can not only recognise a 
large variety of topological Invariants, but can do so in times that 
are almost minimal for a certain class of machines r 

tfe begin by describing our model of the modular array as a 
pattern recognition device and presenting a simple but ticee Consuming 
method of recognizing connectivity > Next we introduce a fundamental 
transformation of patterns and prove several Interesting properties 
of the transformation. Finally h we apply the transformation, to modular 
arrays to obtain fast methods of recognising a wide variety of 
topological invariants. 
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Modular Arrays 

Consider a finite, rectangular , 2-d tokens tonal, iterative array 
df detereatnlsclt finite state automata r Such an array la pictured 
below With the automata represented by squares. 



The automata used in such a construction are Called modules and 
the entire arrangement is called a [nodular array . Wfe assume that 
all of the rtodulfra in the array are identical and have been placed in 
the array with uniform orientstlon* Each module is connected directly 
to its four nearest neighbors* The array functions synchronously with 
the state of a module at time t + 1 being a function of the state of 
it and its four neighbors at time t* 

The above description assumes that every module in the array has 
four nearest neighbors while, in the diagram above it appears that the 
ewdules on the edges and corners of the array have fewer than four 
neighbors. 

Wo assucrc that in fact these boundary modules do have four nearest 
neighbors where the neighbors not pictured above are special one state 
automata tailed edge markers. The use of edge markets allows a module 
to determine whether or net it is on the boundary of the array and to 
behave accordingly. The state transition diagram of a module thus 
explicitly contains descriptions of the behavior of that module in each 
Of the sixteen possible situations in which it Can find itself with 
respect to the edges of an array. 

To operate a modular array as a recognition computer for black 
and white pattern* one designates two module states- as Initial states 
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corresponding to black and white. At tide t ■“ o every rodule in die 
array is placed in one of the two initial states and the pattern of 
states thus created represents the pattern to be processed. Beginning 
with the initial state representing the pattern* the array proceeds 
from state to state until finally a designated module in the array 
(we will always use the northwest corner module) enters one or the 
Other of two Specially designated decision states thus indicating 
whether the pattern is accepted or rejected. The decision states 
are ass Mined to be terminal in the sense that once a module enters 
such a state it remains in that state forever* 

fteuiark , he always require the array to come to a definite accept or 
reject decision. This requirement is Justified E>y the fact that given 
any module H with a designated accept state (but not necessarily a 
reject state) there is a module M* with an accept and a reject state 
Such that the 11* arrays will accept euactly those patterns accepted 
by the h arrays and reject euactly those patterns which are never 
accepted by the 11 arrays. (This result is most easily shown via 
the equivalence mentioned below between modular arrays and linear 
bounded autoiiata although It can be proved directly and must be done 
so If timing considerations are important.) 

Assllm we have a predicate ijf defined on all finite, rectangular 
black and white patterns. A module M is said to r ecognis e gj if the 
modular arrays constructed from M accept enactly those patterns for 
which t is true and reject all others. The class of all predicates 
which ere recognizable by modular arrays form a boolean algebra, 
contains all predicate which are true for only finitely many patterns* 
and is equal to the class of all predicates which are recognizable by 
2-dimensional linear bounded automata. 

Remark .. A 2-diwensi-onal linear-bounded automaton is a finite state 
deterministic automaton which is allowed to walk about on a pattern* 
read and write on the pattern with symbols from some finite alphabet 
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and sense Che edges of the array. If the automaton eventually halts 

in an accepting- state, it is said to accept the pattern, otherwise it 
is said to reject the pattern. It is not difficult to see that modular 
arrays can. simulate linear bounded automata and vice versa. U 6 in ft this 
equivalence one can staOw by a diagonalisation argument that there arc 
effectively recognisable predicates which cannot be recognized by any 
module. 

Given a modulo fl which recognises a predicate ^ we will be 

interested In how "fast 11 M is able to carry out this recognition. 

Given any pattern F, let t^(F) he the amount of time requited by an 

M-array to accept or reject F. The time t^P) will vary from pattern 

to- pattern, hut ifl general one would expect t (P) to increase as the 

H 

number of Squares in the pattern increases< 

Let ^(npiii) - max (t^XF} | ? ia an n x m pattern }* 

Thon, f is called the guara nteed maximal time for M to recognize ^ 

In the following section we will use the guaranteed maximal time as 
our criterion of how fast a given module recognizes a given predicate♦ 
Note that the amount of time required for a signal to travel from the 
southeast to the northwest corner of an n x m array ia approximately 
n +- m. Thus for reasonable predicates a guaranteed maximal time of 
approximately n + c. Is opt tan I, 

We conclude this section by mentioning a result which we call 
the speed-up theorem. This result states that given any module M 
which recoginizea £ predicate v, and given any real nurmhei t > 0 
exists a module M* such that 

f ]q* c (1 +■ e)(a + n) + c 1 f H <n ? m) 


for all n;m.. 
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Ska Loii af Proof . The M* - artsy spends approximately (1 - e) (e + n) 
units &£ time packing the original pattern into the northwest portion 
o£ the array so that each module in that portion is responsible for 
a largo block of squares in the original pattern. The next 2e ■ (n+m) 
units of time are used for -fin application of the firing squad problem* 
When the firing squa4 goes off, the packed portion of the M*-array 
begins simulating the action of the M^artay On the pattern, but because 
Of its packed nature it is able to do so at a higher fate of speed* A 
description of the firing squad problem can be found in Ealzer [3] and 
the use of packing to speed up arrays is discussed in Cole [4]* 

A guaranteed maximal time of the form f u (n,m> = am + b n + c 

Tj 

is said to be linear . A corollary o-f the speed up theorem is that 
if a predicate can be recognized with a linear guaranteed maximal time, 
then for any s>o it can be recognized with a guaranteed maximal time 
of (1 -I- s)(m + n) . Therefore in view of our remarks above about (m 4- n) 
being optimal {modulo a Constant ) f we see that a linear guaranteed 
maximal time ig M alraOst" optimal. The purpose of this paper is to show 
that a wide variety of topologically invariant predicates can be 
recognized with a linear guaranteed maximal time. 





Recognition of Conne c t i_vi ty 

We now describe a simple method of recognising, connectivity by 
modular arrays. That £s a we wish to describe a module M which 
recognises ^-connected, Rather than describe M explicitly via a 
state diagram, or state transition table, we will describe M 
implicitly by describing the action of an Ji-arrdy on a typical 
pattern. It will be left to the reader to, convince himself that 
one could write down a state description qf a [module H such that 
any M- array would carry out the process described. 

Initially (t=o) the pattern is introduced into the array> 

Hie nqrawest comer module immediately omits a scanning signal s 
which begins to scan the array rpw by row in a back and forth manner 
until it encounters a black square* This stage of the process is 
illustrated, in the following figures. 
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At the point at which £ encounters the first black square two 
things happen r First of all a chain reaction of erasure is set off 
Within the component of the pattern to which the black square belongs. 
The black square which was struck by s. turns white and emits an otase 
Signal _e to each of its four neighbors. The £ signals are ignored by 
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white squares tut an e. signal striking a black square causes it to 
turn white and emit £ signals to its four neighbors. 

In this manner the entire component Is erased. The second 
thing which happens when _s encounters the first black square is 
that s_ changes into a waiting signal W., The watting signal 
continues the same zig-zag scanning notion which a. had been using 
hut doea not interact with either black or white squares or with 
je signals which are propagating around the array in various directions - 
The w signal eventually Completes the scan of the array and strikes 
cue of the bottom corners of the array. At this point the erasure 
of the component is guaranteed to be complete. iMhy?) h 

The first three Stages of the erasure process are shown in the 
fallowing figure* 

□ □□□ □□□□ □□□□ 

+e 



When w strikes the corner at the end of its. Stan, the pattern 
contains one less component than it did to begin with. All that 
retnalns to be done is to aee if the remaining pattern is blank. This 
is accoaiplished by having the w signal rebound from the last corner 
as an, accept signal a_ which scans up the array searching for a black 
square. 

If a. encounters a black square it is converted into a reject 
signal _r which heads directly far the northwest corner to cause a 
reject. If a doesn't encounter a black square* it eventually strikes 
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the northwest corner causing, an acce.pt * 

The case of the hlank figure is handled by having the s_ signal 
rebound as a when it -completes Its scan*. 

The module implicitly -described above recognises connectivity 
with a guaranteed maximal time apptoJtimately 2nm and hence is not 
optimal. The reader is challenged to field a faster method of 
recognizing connectivity before reading the next section. By a 
faster method we mean of course a method with a linear guaranteed 
maximal time. A good (or bad, depending on your point of view) 
example to keep in mind while searching for a linear method is the 
pattern illustrated below which has length and area of about *s nm. 
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A Fund-ama ntal Tr ana format ion 

In this section ue present a simple transformation of black and 
white patterns which will have important applications to the recognition 
of topological invariants by modular arrays* Toe transformation will be 
studied in its -own right in this section and its applications will be 
discussed in the following section* 

We first introduce some notation and terminology* Let P be a 
pattern with n rows and m columns* We say P is an n x m pattern and 
introduce coordinates by numbering the rows from top to bottom, the 
columns from left to right and assigning the coordinate (1,j > to the 
square in the i-th row and j-th column* Two squares (i,j) and {p h q) 
are said to be adjacent if ji-pj + jj-q 1 f 1 and are said to be 
n eighbo r ing if Jl-pS < 1 end |j-q] * 1* Two black Squares are 

CgBttgCtgd if there is a chain of pairwise adjacent black squares 
beginning with one and ending with the other* Two white squares are 
conneotud if there is a chain of pairwise neighboring white squares 
beginning with one and ending with the other* Mote the asyunCtric 
definition of connectedness for black and for white Squares. Some such 
asymmetric definition is necessary if one is to retain such "nice" 
properties as the Jordan Curve Theorem. 

Remark * A notion of connectedness which is synnotric with respect 
to black and White cun be obtained by assuming that asoh square "touches" 
all of the neighboring squares except the ones to the northeast and the 
southwest* This notion which is derived from a hexagonally partitioned 
pattern is T however* asymmetric with regard to direction. 

The equivalence classes of black squares under the relation 
’"connected 1 ' are called the componencs of P* the following definitions 
are motivated by our assumption that the pattern Lies on a white 
background. The equivalence classes of white squares under the relation 
"connected 1 ’ which do not contain squares on the border (that is squares 
in rows 1 or n or in columns 1 or n) are called holes . The remathing 
equivalence classes of white squares arc lumped together into a class of 
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white squares called the bacSyyround, A component or hole -which contains only 
one square Is said to he Isolated , otherwise non- isolated ■ 

Given a square in a pattern, Che eight neighboring Squares are referred 
to as the northern neighbor , the north-eastern neighbor , the eastern, n eighbor , 
and as on* 


He now describe a tcansforiaaCion T which takes any n x. m pattern P into 


a sew n it m pattern T {?) . The transfer ration may be thought of as taking 


place in three steps. 


Step L. Color all southeast comer 
squares of the black subpattern red. 

(That is if a square is black and its 
eastern and southern neighbors are white, 
color it red.) 


Step 2 . Color all southeast corner 
squares of the white subfigure black. 
(That is if a square is white and its 
eastern and southern neighbors are 
black and its southeastern neighbor 
is either red or black,, color it black.) 


Step 1 , Color all red squares white. 



J, Step 1 
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Ve now informally describe the properties of T. The remainder of this 
section will be devoted to proving these properties. If one considers repeated 
applications of T to a pattern, one observes that each component is reduced to 
an isolated component which then disappears. Distinct components reiaain distinct 
and either vanish at different points or at Che same point at different times. 
Similarly, each hole ig reduced to an isolated hole which then vanigheg with 
distinct holes remaining distinct end vanishing at different points or different 
times. It is easy to calculate exactly how many app11cations of T will be 
required to reduce a component or hole to a single square and exactly where that 
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square will be, tha entire pattern* no matter how complex* will be 
reduced to the all w h£te background In legs than n + m applications 
of T. 

To begin proving the above statements we need- some way of 
relating the components of F to these of T(P) + This is done in the 
next three propositions by uS log the concept of a stationary point. 

A square X is called a stationary point of P if it is black in both 
P and T(P’) . Note that the stationary poirtts are exactLy those black 
squares in P which are not southeast Corners of the black subpattern 


Of P, 

Proposition 1 , Every non-Iso 1-ated coiTrponent of P contains a 
atationary point. 

Proof : Let C be a non-iso Lilted component and let X be 

a northwest comer of C, Then X must be a 


stationary point for otherwise it would also 
be a southeast corner and hence C “ {X} would 


be isolated. 


Proposition 2 . 


Two stationary points are connected in P if and only 


if they are connected in T (P), 

Proof 1 [—>3 Let it and y be two stationary points Of F 

which are connected. Then by definition there 
exists a sequence x , ac. p .+*, of distinct 

pairwise adjacent '" black Squares 

such that x = and y ■ at , We use induction 

on n. If n = I then x is adjacent to y and we 
are done. If n * 2 then either k is also a 
stationary point in which case we are done, or 
nn is a southeast corner. In the latter case 
we have the situation depicted (next, page), 
possibly with x and y interchanged* and one seas 
that the square r will be black T(P) no oatter 
what its Color in F, Thus X and y are connected 
in T(P)+ 
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R T(P) 


Now assume n } 3, Observe that any chain of 

distinct pairwise adjacent black squares cannot 

Contain two consecutive southeast corners. Thus 

either . or X^ ^ i® 3 stationary point and 

we may apply Che induction hypothesis to the chain 

x > -r ^, i and x, , . . ., 7. where k is either 
Q a K Hi 

n - 1 or n - ir Thus x is connected to y in T(P) 

via it . 
k 

[<£= j Suppose x and y are connected in. T(P) and 
let x^ s ... t x^ be a sequence of pairwise 

adjacent black squares in P(T) such that s ■ s 

0 

and y = x^. Again we use induction and again the 

cases for n = 1 and n ■ 2 with x^ a stationary 

point {of P) are trivial„ so assume n = 2 and x. 

is not a stationary point. Then x., must have been 

white in F since it is black in T(F). Hence x. must 

have satisfied the conditions in step 2 of the 
description of T and the situation depicted below 
must have obtained in P. 
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If a know that x and y are adjacent to and are¬ 
ata denary points, so it will be sufficient to 
show that ail stationary points which, are adjacent 
to 3 .^ arc connected to each ether. 

tIow if a is a stationary point, then a is not a 
southeast corner in P and hence both a and a^ are 
black in P. Thus a is connected to e-, A similar 
argument holds fot b. Thus all stationary points 
in P are connected to *, This completes the case 
for n = 2. 

The remaining cases for n >, 3 follow again from 
the observation that either or is a 

stationary point (although different reasoning 
must be used to sake this observation now since 
x^, is a chain in T(?))v 

Cochining propositions 1 and 2 with the observation 
that every black square in T(P) is either a 
Stationary point of P or is adjacent to a stationary 
point we have shown. 


Proposition 3 . There is a canonical 1-1 correspondeoce between the 
non-isoLated components of P and the components of T(P)+ 
tfe now state without proof the corresponding proposition for holes which 
can be proved by methods similar to those above. However, a slightly 
different concept than that of stationary point must be used since aome 
holes such as that illustrated below, have no stationary points. 
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Preposition 4 k There is a canonical 1-1 correspondence between 

Che nan-isolate holes of P and the holes of T{F). 

Given a pattern one nan construct an associated tree which represents 
the containment relationships between the background* the components 
and the holes. A pattern and its associated tree are shown below. 



Two patterns which have isomorphic trees are said to be topologically 
ec u! val ent ■ The following proposition should be obvious by now* 
Propositio n^5. If F contains no isolated Components Ct hales* 

then P and T(P) are topologically equivalent* 

We now show how to compute the number of applications of T required 
to reduce a component to a single square and where that square will 
lie. Identical results can be proved for holes using similar arguments. 
Given a component C of a pattern F, let 


T D (G) • C 

X^{c) a the canonical image o 


f T k "^tC) 


n(C) = min {i row i intersects C} 
w(G) m tain {j column j intersects G) 
Se(C) “ max a+J I U,J>e Cj 


under T for k * o 
(provided it exists) 


Note that n(C') * w(C) h and se{C> represent three lines forming 
a triangle such that C lies within the triangle and touches 
each line as shown on next page. 
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We will show Chat the component vanishes at the square indicated by the 
dotted lines and that the number of applications of T required to 
achieve this is proportional to the distance from this square to the 
se line. 

Froposition_6 . If C is a non-iselated component t then 

n(T(C)) - n(C) 
w(T(€)) = v(C > 
a«(T(C>> = se (C)-l 

Froof : [ti(T(C)) = n(C)] It is clear that c(T(C)) j n(C) 

since each black square in T(C) ia either a 
stationary point £of F) or is the western 
neighbor of a stationary point. On the other 
hand* if (i T j) is the western most point of C 
which lies, id row n{C}„ then {i f j) most be a 
stationary point and hence n{T(C>) 4 n(0- 
■ w CC)K This result follows 
immediately from, the above and the northwest 
symmetry of T. 

(se(T(C)) ■■ se(C>]. Any square £i h j) in C 
such that 1+ j = se (C) must be a south east 
corner of C and hence is adjacent to a stationary 
point (Pi?) Such that F+q = s*[C) -1. Thus 
se(T(C)) > se{C)-L+ On the other all such squares 
(i,j> do not appear in T(C). so se(TC)) 4 se{C)-L. 


Proposition 7 < If C is a non-isolated coaponent and k(C) - 

se ^C) - n(C) - v(C) , then CC) is an isolated Component located 


at <n(C)» v(C»' 








Proo f: 

By proposition & «e have t(T(C)) = k(G)-l. 

Thus by induction kCT k ^'(C)) - MC) — k(C) = | -" J 0 
which can only hold for an Isolated ccTnq-onent. 

That component must be locatfrd at (n(T^ ^G}), 
w(T k ^ (O)) - ( 0 (C), w(C)} again by proposition 6 

CoroLlarv: 

If P is an num pat tern „ then T tl+fll *"{P) is the a Li 
white figure. 

Proof 2 

Apply Proposition 7 and the fact that k(C)tn+Et-2 
for Arty component C of F. 
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Fa st Recognition -of Tappingi Ca 1 I nmcignta ■ 

The transformation, T, described in the previous section forms the 
basis of the recognition seher.es to be presented in this section. These 
recognition seherteE all have linear guaranteed maximal times and hence 
by the remarks above can ha considered near optimal methods, 

En all of the recognition schemes described below, the modular 
array is thought of as consisting of two layers, a lower, transomation 
layer which carries Out successive transformations of the initial pattern, 
and an upper, observation layer which watches the transformations taking 
place, gathers and processes information, and lin&lly ccmes to a decision 
about the pattern. 

The transformation can be carried out in the lower layer of the 
array at the rate of one transformation every three units of time, 
thus becoming dormant after 3 [a + n — 1) visits of time Cif not sooner) , 
At time t - 0 (mod 3) the pattern is represented in the lower 
layer. By time t = 1 those squares which are to turn red have done so, 

By time t = 2 each black square has entered a state which not only 
indicates that it is black but also indicates what state its southern 
neighbor is in, thua making available to each Tahiti square the 
necessary information for the final step. By the C = 3 a O the 
transformation is complete. The process is illustrated below. 




UQ t=1 


t = 0 


t= 2 




























It now remains- to describe (he observation ldytt for each, predicate 
to be recognised. The observation layers all watch for the disappearance 
of components or holes in the lower layer and generate approp-riate 
signals at each such disappearance, These signals are then processed 
And a decision Is reached. In some cases it is necessary for the 
northwest corner module to know that it has received all the information 
required for a decision. In these cases the southeast corner module 
.sends out g timing, signal which propagates through the array at sn 
Appropriate rgte. When the timing signals reaches the northwest corneT 
module, all other signals must, have preceded it. 

We now list some specific predicate which can be recognised in 
this manner. "The pattern is connected 1 ’: Signals ate only generated by 

vanishing components. As each signal is generated it heads for the northwest 
module. The figure is rejected If more than one such signal is 
received, 

"'All components are simply connected 1 ': Apply the method above 

to holes rather than components and reject any figure with one or more 
holes. 

The two predicates above are examples of the general predicate. 

’"The pattern contains at least i and no more than J components and at 
least k and no rare than I holes." This predicate Is easily 
recognised for any 0 $ < m by simple modification of the 

above t e chniquC s- 

Now consider the predicate, ’ r no component contains more that one 
hole." This predicate is not in the above form but may be recognized 
by having the Observation layer keep each hole signal positioned 
above the component in which the hole was located. If A component 
contains two or more holes 5 the hole signals must eventaujly bump 
into each other as the component is reduced to a single square, Two 
bumping holes cause 4 reject signal, A hole signal located over a 
component vanishes when the component vanishes, 
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The technique of keeping s igtlb3. positioned above components 
or holes gives rise to n pletharA of predicates* one of which is 
"every component which is contained In a hole in another component 
is simply connected, 11 By building a large enough signal set in 
the observation layer one can recognize any predicate of the form* 
H'The pattern is taplogically equivalent to the pattern P' c for any 
fixed pattern P* 
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